Shrinkage Estimators for High-Dimensional Covariance Matrices
نویسندگان
چکیده
As high-dimensional data becomes ubiquitous, standard estimators of the population covariance matrix become difficult to use. Specifically, in the case where the number of samples is small (large p small n) the sample covariance matrix is not positive definite. In this paper we explore some recent estimators of sample covariance matrices in the large p, small n setting namely, shrinkage estimators. Shrinkage estimators have been shown to be positive definite and well-conditioned, two key properties to a good estimate of the population covariance matrix. We test how well the estimators preserve the qualitites of the population covariance matrix and how much information is retained from the sample covariace matrix. We also perform a simulation study to measure the difference between the estimators and the population covariance and compare the different estimators.
منابع مشابه
Nonparametric Stein-type shrinkage covariance matrix estimators in high-dimensional settings
Estimating a covariance matrix is an important task in applications where the number of variables is larger than the number of observations. In the literature, shrinkage approaches for estimating a high-dimensional covariance matrix are employed to circumvent the limitations of the sample covariance matrix. A new family of nonparametric Stein-type shrinkage covariance estimators is proposed who...
متن کاملShrinkage estimators for large covariance matrices in multivariate real and complex normal distributions under an invariant quadratic loss
The problem of estimating large covariance matrices of multivariate real normal and complex normal distributions is considered when the dimension of the variables is larger than the number of sample size. The Stein-Haff identities and calculus on eigenstructures for singular Wishart matrices are developed for real and complex cases, respectively. By using these techniques, the unbiased risk est...
متن کاملLarge dimensional analysis and optimization of robust shrinkage covariance matrix estimators
This article studies two regularized robust estimators of scatter matrices proposed in parallel in (Chen et al., 2011) and (Pascal et al., 2013), based on Tyler’s robust M-estimator (Tyler, 1987) and on Ledoit and Wolf’s shrinkage covariance matrix estimator (Ledoit and Wolf, 2004). These hybrid estimators have the advantage of conveying (i) robustness to outliers or impulsive samples and (ii) ...
متن کاملNonlinear shrinkage estimation of large-dimensional covariance matrices
Many statistical applications require an estimate of a covariance matrix and/or its inverse. Whenthe matrix dimension is large compared to the sample size, which happens frequently, the samplecovariance matrix is known to perform poorly and may suffer from ill-conditioning. There alreadyexists an extensive literature concerning improved estimators in such situations. In the absence offurther kn...
متن کاملLinear Shrinkage Estimation of Large Covariance Matrices with Use of Factor Models
The problem of estimating large covariance matrices with use of factor models is addressed when both the sample size and the dimension of covariance matrix tend to infinity. In this paper, we consider a general class of weighted estimators which includes (i) linear combinations of the sample covariance matrix and the model-based estimator under the factor model and (ii) ridge-type estimators wi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014